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ABSTRACT 

A  r  on  ■*-  i  ngpncy  '  ev  ;  od  by  the  JCAHO  during  its  most 
recent  accreditation  survey  of  DeW : t t  Army  Community 
hosp’ta’  p’^ov^ded  the  iinpeti.iS  for  this  study  of 
comp!  ianre  with  the  standard  regarding  the  use  of  *-he 
med  :  ..:a  '  s'vmmary  1  ist.  A  review  of  outpatient  meriica! 
■^ecor'ds  revealed  the  actual  ‘  eve  I  comp'  iance  with 

the  hospital  was  well  below  the  required  standard  and 
hospital’s  own  goal.  It  was  .also  seen  that  a  signifi 
!  mpr  oveo'e  n  t  cou'd  be  made  over  the  course  of  one  year 
that  90  to  100  percent  comp  1  iance  could  probably  be 
acihieved  with'n  three  years  or  less. 
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A  Study  to  Determine 
the  Level  of  Comp  I  i  ance  W/ith  the 
Joint  Commission  on  Accreditation  of  Health  Care  Organizations’ 
Standard  Requiring  the  Use  of  a  Medical  Summary  List 
in  Outpatient  Medical  Records  at 
DeW/itt  Army  Community  Hospital, 

Fort  Be  I vo i r ,  Virginia 

I.  INTRODUCTION 

"Hospitals  and  health  professionals  must  collect  a 
large  amount  of  sensitive  information  about  patients  in 
order  to  provide  appropriate  diagnosis,  treatment,  and 
care"  (Miller,  1983,  p.  271).  The  Joint  Comm i ss i on  on 
Accreditation  of  Health  Care  Organizations  (JCAHO) 
specifies  medical  record  standards  that  hospitals  must 
meet  in  order  to  be  accredited.  The  Medical  Records 
chapter  of  the  JCAHO’s  Acer ed i tat i on  Manual  for  Hospitals 
I ists  numerous  specific  items  to  be  included  in  the 
medical  record.  These  are  designed  to  assure  that  the 
patient  is  identified,  the  diagnosis  is  supported,  the 
treatment  is  justified,  and  the  results  ar^  accurately 
documented  (JCAHO,  1989.)  While  many  of  the  specific 
items  are  app I icable  only  to  inpatients,  the  general 
standards  are  app I icable  to  al I  patients,  including 
ambulatory  care  patients.  In  fact.  Standard  5,  as  it 
appeared  in  the  Hosp i ta I -Sponsor ed  Ambulatory  Care 
Services  chapter  of  the  1985  edition  of  the  Accreditation 
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Manual  for  Hospitals  required  that  a  medical  record  be 
maintained  on  every  patient  who  receives  ambulatory  care 
services  (p.  63).  Also  in  1985,  the  required 

characteristics  of  such  a  record  were  expanded  to  require 
"a  summary  I ist  of  significant  past  procedures,  past  and 
current  diagnosis  or  problems,  and  currently  and  recently 
used  medications  [be]  legibly  recorded  in  the  same 
location  in  each  patient  record"  (JCAH,  1985,  p.  64)  . 

While  a  variety  of  probi em  list  forms  had  been 
approved  for  use  at  various  Army  hospitals  prior  to  1985, 
the  new  JCAHO  standard  was  a  mandate  for  the  creation  of 
a  Single  form  to  be  used  consistently  throughout  the  Army 
health  care  del ivery  system.  In  order  to  accommodate 
this  new  requirement,  in  January  1985,  the  U.S.  Army 
Health  Services  Command  (HSC)  developed  a  test  form,  the 
HSC  f^orm  79  R,  Master  Problem  List  (Appendix  A)  ,  to  be 
included  in  al I  outpatient  medical  records.  The  form  was 
then  made  available  to  DeW i tt  Army  Commun ity  Hospital 
( DACH )  and  other  Army  med i ca I  treatment  facilities  along 
with  guidance  regarding  its  use  and  placement  in  the 
medical  record.  This  guidance  was  first  fielded  in  the 
Commanding  General  HSC  Bui  let  in  No.  3-85,  which  included 
directions  as  to  the  minimum  information  to  be  recorded 
upon  the  patient’s  initial  visit  after  incorporation  of 
the  form  into  the  record  and  information  to  be  recorded 
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pursuant  to  subsequent  visits.  In  the  years  that 
fol lowed,  HSC  developed  and  fielded  a  newer  version  of 
the  problem  list  form,  the  DA  Form  5571  (Appendix  B). 
However,  HSC  has  found  that  the  use  of  this  form  and  its 
forerunners  within  its  several  cl i n i os  and  hospitals  has 
not  been  consistent  with  the  guidance  it  issued.  Indeed, 
during  the  time  elapsed  between  January  1985  and  the 
present,  results  of  JCAHO  accreditation  surveys  of  Army 
hospitals  have  frequently  cited  noncompi i ance  with  the 
standard  regarding  the  use  of  the  medical  summary  I ist  as 
contingencies  against  f u I  I  accreditation  in  those 
facilities  surveyed. 

Conditions  Which  Prompted  the  Study 

In  April  1986,  OeW i 1 1  Army  Commun ity  Hospital 
underwent  its  most  recent  accreditation  survey  by  the 
JCAHO.  In  October  1986  the  results  of  that  ^u-v^y  v.»'ere 
returned  to  DACH ,  The  hospital  had  been  granted  a  three 
year  accreditation,  contingent  upon  the  resolution  of 
several  contingencies  noted  by  the  surveyors.  One  of 
these  contingencies  concerned  the  use  of  the  medical 
summar  y  list.  The  surveyors'  specific  comment  was ,  "It 
was  noted  that  of  the  25  records  reviewed:  six  contained 
no  summary  I ists  and  ten  omitted  diagnoses  (such  as 


hypertension,  diabetes,  seizures),  past  surgical 
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procedures  (hysterectomy)  and  medications  (Lopressor, 

Scok i n ,  Guipze,  and  Felderene)'  (JCAHO,  1986,  p.  4). 
Included  in  the  letter  notifying  DACH  of  the  survey 
results  was  a  notice  indicating  that  a  return  visit,  or 
focused  survey,  would  be  scheduled  to  determine  whether 
action  had  indeed  been  taken  to  correct  the  contingency 
regarding  the  medical  summary  I ist.  This  resurvey 
occurred  on  25  September  1987.  As  a  result  of  this 
further  examination  of  DACH ’ s  comp  I  i ance  with  the  JCAHO 
standard,  the  contingency  was  removed,  and  thus  DACH ’ s 
accreditation  preserved.  However ,  while  some  i mpr o veme n t 
had  been  noted,  the  JCAHO  indicated  that  DACH  still  was 
not  in  substantial  comp  I  i ance  with  its  standard 
concerning  the  use  of  the  medical  summary  I ist,  and  that 
fu-^ther  improvement  was  needed  before  the  next  fu  I  I 
survey.  The  surveyor’s  specific  comment  was ,  "It  was 
noted  that  not  al I  providers  consistently  document 
medications  in  the  same  location  in  summary  I ists" 

(JCAHO ,  1 987  ,  p .  2)  . 

The  next  fu I  1  accreditation  survey  is  slated  to 
occur  in  April  1989.  Noting  this  important  date  and  that 
concern  had  also  been  expressed  by  the  hospital’s  Quality 
Assurance  Committee,  as  we  I  I  as  the  result  of  the  focused 
survey,  the  Deputy  Commander  for  Administration  (DCA) 
directed  this  investigator  to  assess  DACH ’ s  current 
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b.  Records  in  which  the  medical  summary  I ist 
wa  >  either'  in  lank  -rr  improperly  completed. 

r  .  Records  in  which  the  form  was  not:  f  i  led  in 
t  h  e  c  o  r  e  c  t  I  o  i.t  a  t  i  o  n  . 

d.  Records  in  which  the  patient  identification 
''ota  was  not  ec c- •' cted  on  the  form, 

e.  Re'VC'''ds  in  which  medications  were  not 
'  e  c  ■  J  "■  d  e  d  :  .n  the  correct  location. 

.  The  number  of  personnel  ,  whose  records  are 
^.e'd  by  PACM ,  wbo  presented  for  care  at  a  clinic  wherein 
the  medica'  summary  i ist  could  have  been  completed  dur  i ng 
a  Che  year  ,.n  e  r  i  o  (i  . 

5.  "^rans'orm  the  percentages  obtained  by  computing 
confidence  intervals  to  actual  numbers  o*  outpatient 
mad'ea!  records  to  determine  the  number  of  records 
exhib  ting  the  c ha r ac t e r i s t i cs  of  concern, 

6.  leveiop  conclusions  and  recommendations  to  be 
presentee  c rj  the  DCA  regarding  means  to  achieve  the  goal 

90  ner  it  compliance  w^tti  the  JCAHO  standard,  i 
indeed  it  had  not  already  been  met. 
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2.  Ar,  y  mod  dr  a'  surtmary  '  st  which  was  not  ^  '  ed  on 
t  ■  e  top,  'eft  side  o'"  t'-u  ■' o.-i :  or  d'.-,  ^.ic'set  was  not 

cor;  si  dor  ad  'I'o  have  been  t  '  '  od  in  the  cor  r  cm,''  'oca*  ’■jn. 
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completed  if  any  part  of  the  medical  summary  list  was 
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any  part  of  tbs  d  a  t  a  we  re  le-t  b'ank,  with  the  exception 
of  the  date  rescilved,  then  that  entry  was  considerec  to 
be  irnproper'y  completed. 
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That  the  pattern  of  patient  visi 


o  V  i  d  e  n  c  e  d 


Pr  Ob  I em  List 


1  5 

during  the  period  addressed  by  the  study  will  r ema i n 
relatively  constant  over  the  following  year. 

Limitations 

The  examination,  or  audit,  of  outpatient  medical 
records  was  I imited  to  those  held  by  DACH .  Records  held 
by  outlying  Troop  Medical  Cl i n i cs  (TMCs)  were  not  included 
owing  to  the  Army  Medical  Department’s  po I  icy  that  Army 
med  i ca I  t  r  ea  tmen  t  facilities  (MTFs)  will  only  include 
data  concerning  " hasp i ta I - based  cl  i n  i  cs  which  are  an 
integral  part  of  the  hospital"  (Department  of  the  Army, 
1988b)  when  completing  appi ications  for  JCAHO  survey. 

Also,  the  cross-sectional  nature  of  this  study 
dictates  that  the  information  derived  from  analysis  of 
the  data  obtained  from  the  audit  of  outpatient  medical 
records,  presents  a  picture  of  DACH ’ s  position  relative 
to  the  goal  of  90  percent  compi i ance  at  one  point  in 
time.  That  is,  the  dynamic  nature  of  the  body  of  such 
records  held  by  DACH  is  not  reflected  in  the  results 
obtained.  Similarly,  any  long  term  strategy  derived  to 
improve  compi i ance  with  the  JCAHO  standard  should  take 
into  account  the  fact  that  some  number  of  records  held  on 
any  given  day,  in  which  the  medical  summary  I ist  is 
present  and  properly  completed,  may  not  be  held  on  any 
subsequent  day,  owing  to  the  patient’s  transfer  or  other 
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circumstances.  Likewise,  records  newly  added  to  the  body 
held  by  DACH  may  need  to  have  the  form  enclosed  and 
properly  completed.  Clearly,  the  picture  today  may  not 
be  the  picture  tomorrow. 

Review  of  the  Literature 

Origin  of  the  Medical  Summary  List 

The  works  consulted  in  this  review  of  I  iterators  are 
unanimous  in  crediting  Or.  Lawrence  L.  Weed  with 
developing  the  concept  of  the  problem-oriented  medical 
record  (POMP)  (Watzlaf,  1988;  Donaldson  and  Povar ,  1985; 

Papa,  1985;  Margol is,  Barak,  Vardy,  and  Winter,  1984; 
Sigurdsson,  Einarsson,  Josafatsson,  Magnusson,  Olafsson, 
Sigvaldsson,  Thorarinsson,  and  Tulinius,  1984;  Freer, 

1980;  and  Holmes,  1980)  .  First  presented  in  1968,  Weed 
proposed  the  POMR  as  an  "expl  icit,  logical  format  for  the 
often  fragmented  patient  record.  Al I  cl i n i ca I  notes, 
laboratory  information,  and  radiologic  data  in  the  POMR 
were  to  be  keyed  [to  what  Weed  termed]  a  master  problem 
list  (MPL),  an  index  to  the  patient’s  entire  med i ca I 
record"  (Donaldson  and  Povar,  1985,  p.  328)  . 

Weed  contended  that  the  patient’s  medical  records 
wer  e  frequently  "a  tangle  of  i  I  logically  assemb led  bits 
of  information  organized  by  source  rather  than  patient 
problems"  (Holmes,  1980,  p.  42).  Hence,  such  a  record 
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\A/as  an  impediment  to  the  physician’s  first  task,  that  is, 
to  "identify  the  patient’s  problems  and  organize  them  for 
solution"  (Weed,  1969,  p.  3).  Weed’s  premise  was  that 
medical  education  did  I  ittle  to  prepare  the  physician  to 
apply  the  sort  o*  scientific  methodology  to  the  scrutiny 
of  patient’s  records  that  would  enable  him  to  deal 
successfully  with  complex  biological  systems .  To  clarify 
the  point,  he  makes  an  analogy  between  a  physician  and 
other  scientists: 

The  scientist  defines  a  problem  clearly, 
separates  multifarious  problems  into  their 
individual  components,  and  clarifies  their 
relationships  to  each  other.  He  records  data 
in  a  communicative  and  standard  form  and 
ultimately  accepts  an  audit  from  objective 
peers  by  seeking  pubi ication  in  a  journal . 

Basic  scientists  are  neither  better  people  nor 
better  scholars  than  physicians;  they  do  not 
pursue  more  scientific  or  intrinsically  ’better’ 
problems.  They  are  simply  subject  to  better 
mon  i  tor  i ng  by  a  system  that  mob i  I  i zes  the 
criticism  of  their  peers  throughout  their 
I  i  ves .  Cl  i  n i ca 1  medicine,  on  the  other  hand, 
substitutes  qual ifying  exam inations  at  a  single 
point  in  a  career  for  a  I  ifelong  process  of 
recurring  audit  and  it  must  frankly  be  admitted 
that  the  customary  methodology  of  medicine 
f a i Is  to  provide  the  kind  of  structured 
context  that  promotes  objectivity,  sharpens 
skills,  and  permits  progressive  self-evaluation 
( 1 969  ,  p .  4)  . 

As  presented  by  Weed  (1969)  ,  the  POWIR  is  a  tool  to 
guide  and  teach  clinicians  as  we  II  as  to  facilitate  and 
assess  the  qual i ty  of  care  actual ly  provided  a  patient. 


The  POMR  concept  recognizes  four  basic  elements  of  the 
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medical  record;  (1)  the  data  base,  which  includes  the 
patient’s  chief  complaint,  a  patient  profile  and  related 
social  data,  present  illness,  past  history  and  revi ew  o  f 
systems,  physical  examination,  and  laboratory  reports; 

( 2 )  the  master  pr ob I em  list,  i . e . ,  a  numbered  and  titled 
I  ist  of  every  problem  the  patient  has  or  has  had,  to 
include  anything  that  requires  management,  as  we  I  I  as, 
social  or  demographic  problems;  (3)  the  initial  plan, 
which  is  a  I ist  of  diagnostic  and  therapeutic  orders 
which  are  keyed  by  number  to  the  original  problem  I ist; 
and  (4)  the  progress  notes.  Each  progress  note  is 
written  so  as  to  correspond  to  the  specific  problem  to 
which  it  refers.  The  progress  notes  consist  of:  (1) 

narrative  notes,  written  in  a  standard  format,  which  are 
also  numbered  and  titled  such  that  they  are  keyed  to  the 
problem  I ist,  and  include  notes  written  by  nurses  and 
paraprofess i ona I  personnel;  (2)  flow  sheets,  addressing 
al I  of  the  moving  parameters  of  a  given  problem;  and  (3) 
the  discharge  summary,  which  should  address  each  numbered 
problem  on  the  patient’s  list.  As  noted  by  Holmes  (1980) 
the  progress  note,  with  its  char ac ter  i  s t  i  c  S-O-A-P  format 
is  perhaps  the  best  known  part  of  the  POMR .  The  first 
element  of  such  a  note  is  labeled  "S,"  for  subjective 
data,  and  should  address  symptomatic  data,  i.e.,  what  the 


patient  says . 


This  el ement  is  listed  first  as  it  was 
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Weed's  feel i ng  that  the  patient's  point  of  view  should  be 
taken  into  consideration  at  the  outset.  The  second 
e I emen t  listed  should  be  labeled  "0,  "  for  objective  data. 
Physical  findings  and  the  results  of  tests  and 
measurements  are  recorded  under  this  element.  The  next 
element  is  labeled  "A,”  for  assessment.  Here  the 
cl  inician  was  to  record  conclusions  based  on  both  the 
subjective  and  objective  data.  The  last  element  is 
labeled  "P,  "  for  plan.  It  is  here  that  plans  tor  further 
diagnostic  work-up,  therapy,  and  patient  education  are 
documented.  The  plan  is  meant  to  outi i ne  specific 
actions  related  to  patient  activity,  ob.ser  va  t  i  ons  ,  and 
diagnostic  studies. 

Subsequent  Development  of  the  POMR  and  the  MPL 

Since  the  introduction  of  the  POMP,  both  it  and  the 
MPL,  have  been  widely  used  and  modified.  Ruth,  R i gdon , 
and  Brunworth  (1979)  report  the  development  and  use  of  an 
integrated  family-oriented  problem-oriented  medical 
record  (I NFO-POMR) .  Based  upon  Weed’s  original  concept, 
"the  INFO-POMR  requires  a  family  chart  that  encloses 
individual  folders  for  each  member  of  the  f am i I y .  It 
cannot  be  used  whe.n  cha'^ts  are  filed  separately.  thp 
Fami ly  Master  Problem  List  is  attached  to  the  inside  of 
the  family  folder"  (Ruth  et  al,  1979,  p.  1179).  This 
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Fami ly  Master  Problem  List  is  the  only  MPL  in  the  record. 
It  is  designed  in  a  matrix  format  and  contains  the  master 
prob I ems  of  all  members  of  the  f am i I y .  While  Weed ’ s 
design  calls  for  probi ems  to  be  listed  numer ically  on  the 
MPL  in  chronological  order,  Ruth  et  al  assign  numbers  to 
identified  problems  by  the  use  of  the  International 
Classification  of  Health  Probi ems  in  Pr  i mar  y  Care 
(ICHPPC).  They  note  that  while  any  c  1  ass  i  f  i  ca t i on 
system,  such  as  the  ICHPPC,  can  be  used  to  number 
identified  problems,  such  systems  lend  themselves  we  I  I  to 
chart  audit,  disease  registry,  research,  and 
computerization.  Further  expanding  on  Weed’s  model,  the 
INFO-POMR  includes  a  family  profile,  meant  to  offer 
insight  to  secondary  providers  and  consultants.  This 
facet  of  the  Fami ly  Master  Problem  List  is  also  an  aid  to 
determining  whether  the  problem  of  concern  is  in  the 
individual  patient  or  the  f am ily  (Ruth  et  al,  1979). 

"The  reverse  of  the  fami ly  problem  page  contains. . .a 
geneology  [of  the  f am ilyl"  (Ruth  et  al,  1979,  p.  1180). 
The  INFO-POMR  also  contains,  separate  from  the  Fami ly 
Master  Problem  List,  a  Temporary  Problem  List  and  a 
Chronic  Medication  List.  This  latter  document  is 
maintained  on  each  member  of  the  fami ly  and  is  located  on 
the  inside  front  page  of  each  individual’s  chart.  It  is 
intended  as  a  tool  to  record  self-1 imited  problems.  The 
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creation  of  the  INFO-POMR  is  a  reflection  of  the  concern 
expressed  by  many  family  practice  providers  and  others 
over  putting  the  family  into  family  practice. 

Papa  (1985)  reports  the  development  of  an  emergency 
medicine  cl inical  problem-solving  system  (EMCPSS)  which 
follows  from  the  POMR  de'/ised  by  Weed.  Papa  contends 
rhat  "in  a  -field  as  broad  as  erne  r  gency  med  i  c  i  ne  ,  no 
physician  can  remember  the  most  complete,  accurate,  and 
current  information  necessary  for  the  highest  level  of 
diagnostic  proficiency.  Such  I  imitations  make  the  need 
for  accessible  reference  materials  obvious"  (1985,  p. 
660).  In  this  regard,  he  notes  the  primary  advantage  of 
the  POMR  is  the  inclusion  of  a  concise  I ist  of 
"problem-oriented  differentials,  or  cause  !  ists"  (1985, 
p.  660) .  Herein,  however,  he  finds  the  chief  flaw  in  the 
POMR  stating  that  "as  the  body  of  medical  information 
grows,  these  cause  I ists  lengthen,  making  it  difficult 
for  physicians  to  use  them  maximal ly  in  cl inical  problem 
solving"  (1985,  p.  660).  Papa  characterizes  Weed ’ s  POMR 
as  pr imar ily  a  record-keeping  system  wh ich,  although  it 
impi i es  an  information  processing  methodology,  does  not 
ovpi icitly  support  information  processing.  Designed  to 
be  compatible  with  the  information  recording  procedures 
inherent  in  the  POMR  and  also  to  I  ink  that  data  with 
information  sources,  the  EMCPSS  is  meant  to  aid  the 
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physician  in  making  rapid  and  accurate  diagnoses. 

The  EMCPSS  is  composed  of  five  phases:  (1)  a 

prel iminary  data  base,  as  described  by  Weed;  (2)  problem 
identification,  also  as  described  by  Weed:  (3) 
problem-oriented  medical  inquiry;  (4)  pattern  matching; 
and  (5)  patient  management,  as  described  by  Weed.  So  it 
may  be  seen  that  in  Papa’s  approach,  phases  three  and 
four  are  the  information  processing  phases  of  the  system. 
Phase  three,  the  problem-oriented  medical  inquiry, 
includes  four  steps:  (1)  defining  the  problem-oriented 

cause  I ist;  (2)  redefinition  of  the  cause  I ists  into 
structural ,  or  tissue  and  organ  systems,  and  functional , 
or  path i ophys i o I og i c  process,  commonal ities;  (3)  focused 
patient  reevaluation;  and  (4)  ranking  of  structural  and 
functional  commonal ities.  The  first  step,  according  to 
Papa  (190.5)  ,  is  to  construct  a  I  ist  of  nhe  several 
possible  causes  of  the  problem  of  concern.  Next,  the 
physician  attempts  to  reduce  this  I ist  of  perhaps  20  or 
more  potential  causes  to  a  maximum  of  four  to  seven,  so 
that  he  is  not  overloaded  with  data.  This  is  to  be 
accompi i shed  by  redefining  and  summarizing  the  items 
enumerated  in  the  cause  1 ist  into  structural  and 
functional  commonal ities.  The  physician  then  reevaluates 
the  patient  in  a  general  sense,  using  general  cl  i  n i ca I 
sk ills,  "separate  I y  focus i ng  on  and  compar  i ng  among  a 
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handful  of  structural  and  functional  causes"  (Papa,  1985, 
p.  663)  as  they  have  been  redefined.  Final ly,  in  phase 
three,  the  physician  ranks  both  the  structural  and 
functional  issues  most  likely  contributing  to  the 
problem.  Thi-^  1  ead  i  .ng  issues  are  then  combined  and 
'■epresent  a  prel  iminary  impression  to  be  processed  in 
phase  four , 

Phase  four  of  Papa’s  mode! ,  pattern  matching,  is 
comprised  of  five  steps.  These  are:  (1)  defining 

patterns  or  diseases  to  be  matched;  (2)  comparison  of 
disease  patterns  with  patient  findings;  (3)  ancillary 
tests,  for  further  diagnostic  refinement;  (4) 
determination  of  the  most  I i ke I y  diagnosis;  and  (5) 
estimation  of  diagnostic  confidence.  In  step  one,  the 
signs  and  symptoms,  or  patterns,  attributable  to  the 
d  i  sea.ses  or  disorders  consistent  with  the  prel  iminary 
impression  derived  in  phase  three  are  enumerated.  In 
step  two,  these  patterns  are  matched,  where  possible,  to 
patient  findings.  In  the  third  step,  the  physician  may 
order  additional  tests  to  further  distinguish  among  the 
possible  final  diagnoses.  Upon  obtaining  the  results  of 
these  additional  tests,  in  step  four,  the  physician 
c, oncludes  the  most  likely  diagnosis.  And  finally,  in 
step  five,  the  physinian  "acknowledges  his  degree  of 
confidence  in  his  diagnosis  in  light  of  the  results  of 
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the  work  so  far"  (1985,  p.  6631. 

Sigurdsson  et  a!  (1904)  report  the  development  of  a 
problem-oriented  medical  record  for  use  in  primary  care. 
In  Iceland,  prior  to  1975,  documen  t  r.  compr  i  s  i  ng  a 
p  a  t  i  e  n  f  ’  s  me  c)  i  i'  a  i  record  were  ma  intained  in  several 
separate  locations.  Separate  files  for  outpatient  care, 
inpatient  care,  immunization  records,  preventive  health 
records,  and  also  letters  from  hospitals  and  special ista 
were  kept.  New  legislation,  in  1974,  mandated  the 
creation  of  a  new,  consol  idated  medical  record.  This  new 
document  was  comprised  of  eight  forms:  (1)  the  contact 

form,  used  to  record  data  each  time  a  patient  touched  the 
health  center;  (2)  a  probi em  list,  used  as  an  index  to 
the  record;  (3)  a  health  questionnaire;  (4)  a 
continuation  sheet;  (5)  a  flow  sheet;  (6)  a  drug  sheet; 

(7)  a  laboratory  results  sheet;  and  (B)  a  laboratory 
request  form.  Partial ly  automated,  this  system  had  been 
adopted  by  most  health  centers  in  Iceland  at  the  time  of 
Sigurdsson’s  et  al  report.  Advantages  perceived  with  the 
implementation  of  the  pr ob I em  or i en ted  record  include  a 
consol  idated  data  base  and,  owing  to  the  automated  nature 
of  the  system ,  a  we  a  Ith  of  reaoiiy  available  d  t;mogr  aph  i  c 
and  epidemiological  data,  which  has  been  consistently  and 
methodical ly  comp i led  since  1975,  which  is  eas i ly 
retrievable  at  minimal  cost. 


Prob I em  List 


25 


Effective  Implementation  and  Use  of  the  POMR  and  MPL 

While  there  have  been  several  mod ifications  and 
enhancements  to  both  the  POMR  and  the  MPL,  to  fac i I i tate 
a  variety  of  purposes,  their  most  effective  use  has  also 
been  subject  to  study.  Margol is,  Barak,  Vardy,  and 
Winter  (1904)  undertook  a  study  to  de;termine  the  effect 
of  the  POMR  on  the  process  of  medical  problem  solving. 

'^he  use  of  a  POMR  consisting  of  preprinted  data  base 
forms,  a  problem  I ist,  and  problem-oriented  admission  and 
progress  notes  was  implemented  in  a  university  hospital. 
At  three  months  and  15  months  fol lowing  implementation, 
the  quantity  and  type  of  data  collected  and  the  number  of 
problems  identified  were  measured.  Samples  of  100 
records  each,  on  both  occasions,  were  taken  from  the 
university  hospital  and  the  two  control  hospitals,  which 
were  of  simi I ar  size  and  served  approximately  the  same 
sized  populations.  Wh i I e  the  two  control  hospitals  were 
using  only  a  I imited  preprinted  data  base  form,  the  study 
revealed  that  the  quantity  of  data  col lected  by  the  three 
hospitals  was  not  significantly  different,  although  one 
of  the  two  control  hospitals,  which  I isted  more  items  on 
its  preprinted  data  base  form,  did  score  higher  in  terms 
of  both  the  subjective  and  objective  data  recorded.  It 


was  also  noted  that  both  subjective  and  objective  data 
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were  more  thoroughly  recorded  at  the  university  hospital 
fol lowing  implementation  of  the  POMR .  Otherwise,  there 
was  no  significant  difference  noted  among  the  hospitals 
in  regard  to  the  number  of  problems  identified  at  either 
the  patient’s  admission  or  discharge.  Generally,  it  was 
determined  that  "the  introduction  of  standardized  data 
base  forms  increased  data  collection  significantly... 

[and]  that  the  amount  and  type  of  data  col lected 
corresponds  with  the  length  and  degree  of  specification 
Qt  the  preprinted  f o r ms "  (Margolis  et  al,  1984,  p.  1049). 

Mo tw i ths tand i ng  the  several  attributes  of  both  the 
POMR  and  the  MPL,  some  authors  have  identified  aspects  of 
the  concept  which  might  be  improved.  One  of  tl.  v  ’S  to 
do  v,  ith  the  limitations  of  the  language,  i.e.,  "existing 
diagnostic  terms  and  taxonom ies"  (Freer,  1980,  p.  867), 

1.1  sed  by  clinicians  to  describe  ill  health  in  an  holistic 
fashion.  Freer  (1980)  suggests  that  MPLs  do  not 
adequately  communicate  the  unique  mix  of  problems  for  any 
i  nd  i  V  i  dua I  .  He  a  I  so  notes  that  the  POMRs  imp  I emen  ted  i n 
many  health  care  facilities  over  the  years  are  poorly 
documented  and  maintained,  suggesting  that  many 
physicians  using  the  syst em  are  not  f am iliar  with  Weed’s 
original  text.  Based  on  his  own  study,  performed  in  1978 
whe  r  ein  patients  ma  intained  diaries  describing  trieir  own 
health  probl em ,  emo  tions,  and  feelings.  Freer  suggests 
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the  implementation  of  a  new,  more  hoi istic  vocabulary  in 
the  description  of  illness. 

Still  focusing  on  improving  the  effective  use  of  the 
MPL,  Donaldson  and  Povar  (1985)  report  a  case  study  in 
changing  cl inician  behavior.  They  comment  that  the 
qual  i  ty  assurance  subcommittee  of  the  George  Washington 
University  Health  Plan  (GWUHP) ,  a  health  maintenance 
organization  located  in  Washington,  D.C.,  directed  a 
study  of  the  accuracy  of  (VtPLs  in  the  modified  version  of 
the  POMRs  they  maintained.  The  committee  was  concerned 
at  the  potential  for  lack  of  qual i ty  in  the  care 
provided,  inefficient  use  of  resources,  unreliability  of 
the  MPL  for  qual i ty  assurance  (QA)  purposes,  and  the  poor 
qual  i  ty  of  the  POMR  for  educational  and  legal  purposes 
for  the  lack  of  adequate  documentation.  In  their  study, 
"four  pairs  of  physicians  reviewed  25  records  of 
fol low-up  patients  with  estabi ished  MPLs"  (Donaldson  and 
Povar,  1985,  p.  329) .  Each  of  the  records  was  revieweo 
independently  by  each  of  the  physicians  and  then  the 
pairings  were  rotated.  Their  findings  revealed  that  the 
accurate  status  of  problems  were  indicated  in  the  MPLs  in 
only  64  percent  of  the  cases  reviewed  and  that 
significant  probi ems  were  not  listed  in  23  percent  of  the 
cases.  Overal I ,  they  rated  only  44  percent  of  the  MPLs 
as  adequately  documented.  In  a  concurrent  survey  of 
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GWUHP  physicians,  it  was  noted  that  they  "regarded  the 
MPL  as  especial ly  important  when  seeing  patients  they  did 
not  know ...yet  practitioners  rated  their  own  MPLs  as 
midway  betw€!en  optimal  and  inadequate"  (Donaldson  and 
Povar  ,  1985,  p.  329).  Physicians  were  also  noted  to  have 

indicated  that  they  were  only  somewhat  I ikely  to  maintain 
accurate  MPLs  for  their  own  patients.  Pol  lowing  these 
studies,  workshops  on  the  use  of  the  POMR  and  the  MPL 
were  conducted.  Eighteen  months  later,  however,  there 
had  been  considerable  staff  turnover  and  no  appreciable 
improvement  cou i d  be  discerned  in  the  maintenance  of 
MPLs.  Over  the  course  of  the  ensuing  three  years,  the  OA 
subcommittee  attempted  four  successive  interventions  to 
improve  the  situation.  They  conducted  two  in-service 
workshops,  a  feedback  experiment,  and  final ly  a  mandate 
that  teams  of  physicians  develop  their  own  method  for 
updating  all  active  records.  This  latter  plan,  involving 
the  formulation  and  implementation  of  plans  by  the 
physicians  themselves,  produced  a  significant  improvement 
in  the  accuracy  of  the  MPLs  (Donaldson  and  Povar,  1985) . 

Implementation  of  the  MPL  by  the  Army  Medical  Department 

Prior  to  the  appearance  of  Standard  5,  in  the 
Hosp i ta I -Sponsor ed  Ambulatory  Care  Services  chapter  of 
the  1985  edition  of  the  Accreditation  Marrual  for 
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Hospitals,  there  had  been  no  impetus  to  create  a  MPL  for 
consistent  use  throughout  the  Army  health  care  del ivery 
system.  The  growth  of  fami ly  practice  as  an  area  of 
c! inical  special ization  gave  rise  to  the  sporadic  use  of 
MPLs ,  of  local  design,  and  the  concern  of  a  I  imited 
number  of  individual  physicians  in  individual  hospitals 
and  clinics  sometimes  produced  locally  developed  MPLs . 

The  use  of  tf<ese  documents,  however,  often  waned  with  the 
frequency  of  staff  turnover  and  the  press  of  other 
priorities.  Beginning  in  1985,  however,  Standard  5  gave 
new  urgency  to  the  need  to  field  a  MPL  across  the  Army 
health  care  delivery  system  and  to  provide  guidance  for 
its  use  and  placement  in  the  medical  record. 

Procedures  for  the  preparation,  maintenance,  and  use 
of  ambulatory  or  outpatient  medical  records  within  Army 
med i ca I  treatment  f ac i 1 i t i es  (MTFs)  are  prescribed  in 
Army  Regulation  40-66,  Medical  Record  and  Qual i ty 
Assurance  Administration.  A  review  of  this  document 
reveals  that  the  Army  does  not  maintain  its  outpatient 
records  in  the  POMR  format.  Thus,  guidance  concerning 
the  proper  use  of  a  MPL,  to  be  incorporated  into  these 
records,  was  needed.  This  guidance  first  appeared  in  the 
Conmand ing  General,  HSC  Bulletin  No.  3-85.  This  guidance 
stated  that  the  Office  of  The  Surgeon  General  had 


authorized  the  MPL  to  be  filed  as  the  top  document  on  the 
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left  side  of  the  records  jacket,  and  that  MTFs  could 
achieve  gradual  and  systematic  comp  I  i ance  with  Standard 
5,  by  requiring  the  foil ow ing  action  pursuant  to  a 
f.)atient  visit: 

(a)  First  visit  on  or  after  1  January  1985: 

Incorporation  of  a  Master  Problem  List  in 

the  [outpatient!  record. 

2  As  a  minimum,  documentation  of  the  current 
problem  for  which  the  patient  is  seen, 
medications  prescribed,  and  procedures 
per  formed . 

(b)  Subsequent  visits:  as  a  minimum, 

documentation  of  the  current  ’problem’  for 
which  the  patient  is  seen,  medications 
prescribed,  and  procedures  performed. 

(Department  of  the  Army,  1985). 

HSC  also  developed  and  fielded  a  MPL  form,  the  HSC 
Form  79-R.  Later,  in  October  1986,  the  form  was  si ightly 
revised  and  reissued  as  DA  Form  5571.  Compliance  with 
its  guidance  has  become  a  problem  for  HSC  however.  The 
HSC  Inspector  General ’s  Office  reports  that  no  less  than 
five  Army  MTFs  surveyed  by  the  JCAHO  during  calendar  year 
1988  have  received  contingencies  relating  to  their  level 
of  comp  I  iance  with  Standard  5  (Jack,  1988)  . 

Summary 

Several  sal  lent  points  were  derived  from  the 
I  iterate. 'e.  First,  it  is  evident  that  the  MPL  is  only  a 

component  of  the  larger  POMR  concept  advanced  by  Weed. 

It  is  not  intended  to  stand  alone,  rather  it  should  serve 
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as  an  index  to  the  patient’s  record,  facilitating  order 
and  continuity  in  the  document.  Second,  the 
identification  and  documentation  of  significant  problems 
is  enhanced  when  the  MPL  is  used  in  conjunction  with  a 
preprinted  data  base  form.  In  this  regard,  the 
1  iterature  suggests  that  the  more  specific  the  data  base 
form,  the  better  the  documentation.  Third,  use  of  the 
MPL,  in  conjunction  with  appropriate  data  base  forms, 
progress  notes,  and  plans  not  only  facilitates  clinical 
problem  solving,  but  provides  a  base  for  continuing 
education,  quality  assurance,  utilization  revi ew ,  and 
research.  Fourth,  the  POMR ,  to  include  the  MPL,  is 
easily  adapted  to  facilitate  imp  I  erne n tat  ion  in  a  variety 
of  settings.  Fifth,  that  physicians  recognize  the  value 
and  significance  of  the  MPL,  but  are  not  I i ke I y  to  be 
concientious  in  keeping  it  updated.  The  I iterature 
further  suggests  that  the  accurate  maintenance  of  the  MPL 
by  physicians  can  be  improved  if  the  methodology  for 
doing  so  is  one  of  their  own  design.  Final ly,  it  is 
evident  that  the  MPL  currently  in  use  within  the  Army 
health  care  del ivery  system  is  not  an  index  to  the 
outpatient  record  nor  is  it  keyed  to  any  other 
documentation.  Further,  judging  by  the  results  of 
recent  JCAHO  accreditation  surveys,  it  has  been  poorly 
i mp I  erne n  ted ,  at  least  insofar  as  significant  comp  I  i ance 
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with  Standard  5  is  concerned. 

Research  Methodology 

The  initial  step  of  this  research  effort  focused  on 
determining  the  number  of  outpatient  medical  records  held 
by  DACH .  This  information  was  obtained  through 
discussion  with  the  Noncommissioned  Officer  in  Charge  of 
the  Outpatient  Treatment  Records  Branch  of  the  Patient 
Administration  Division,  which  is  responsible  for 
maintaining  all  of  the  hospital’s  outpatient  medical 
records.  The  data  obtained  was  used  to  compute  the 
sample  size  necessary  to  achieve  a  99  percent  level  of 
significance  in  a  cross-sectional  audit  of  the  finite 
population  of  outpatient  records  held  by  DACH  (Appendix 
C).  In  order  to  enhance  the  reliability  of  the  sample, 
an  interval  estimate  of  five  percent  was  selected. 

Further,  since  the  proportions  of  the  characteristics  of 
interest  in  the  population  of  concern  were  not  known,  a 
value  of  .5  was  selected  for  this  probability,  as  it  was 
known  that  this  would  yield  the  maximum  sample  size. 

Having  determined  the  appropriate  sample  to  be 
obtained,  a  cr oss-sec t i ona I  audit  of  the  finite 
population  of  outpatient  medical  records  was  conducted  to 
determine  the  proportions  of  the  population  in  which: 

(1)  a  medical  summary  I ist  was  present,  (2)  the  form  was 
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either  blank  or  improperly  completed,  (3)  the  form  was 
filed  in  the  correct  location,  (4)  patient  identification 
data  was  affixed  to  the  form,  (5)  medications  were 
re  cord  63  d  in  the  correct  location,  and  (6)  documentation 
existed  that  the  patient  had  presented  for  care  at  least 
once  in  a  clinic  wherein  the  medical  summary  I ist  could 
have  been  completed,  during  the  period  1  October  1987 
through  31  September  1988. 

Once  the  sample  data  was  col lected,  99  percent 
confidence  intervals  were  constructed  around  the  true 
proportions  of  the  char acter i st i cs  of  interest  within  the 
population  of  concern.  The  percentages  derived  in  this 
fashion  were  transformed  into  actual  numbers  of 
outpatient  records  exhibiting  these  characteristics. 

Thus,  both  best  and  worst  case  values  were  obtained  for 
each  of  the  characteristics  of  interest.  This  data  was 
then  analyzed  to  determine  the  current  level  of  variance 
from  DACH ’ s  goal  of  90  percent  compi iance  with  the  JCAHO 
standard  and  the  extent  of  improvement  that  could  be 
achieved  within  the  ensuing  year  if  only  cursory  action 
was  taken  to  address  shortcomings. 
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I  I  .  DISCUSS! ON 

In  considering  how  to  best  approach  the  assessment 
of  OACH ’ s  position  relative  to  the  goal  of  90  percent 
cornpi  i  ance  with  the  JCAHO  standard  concerning  the  use  of 
the  MPL,  the  first  critical  task  was  to  determine  those 
characteristics  of  an  outpatient  record  and  of  the  MPL 
which  represented  comp  I  i ance .  The  ground  work  for  making 
this  determination  was  estabi ished  by  reviewing  the  1989 
edition  of  the  JCHAO’s  Accreditation  Manual  for  Hospitals, 
the  results  of  the  most  recent  accreditation  survey,  the 
results  of  the  subsequent  focused  survey,  and  the 
requirements  of  Army  Regulation  (AR)  40-66.  Synthesis  of 
these  materials  culminated  in  the  identification  of  the 
following  characteristics  of  interest:  (1)  presence  of 

the  MPL  in  the  medical  record,  (2)  consistent  placement 
of  the  MPL  in  the  same  location  in  every  record,  i.e.,  on 
top  of  al I  other  documents  on  the  left  hand  side  of  the 
records  jacket,  (3)  presence  of  patient  identification 
data  on  the  MPL,  i.e,  at  least  the  patient’s  first  and 
last  names  and  the  Social  Security  Account  Number  of  the 
patient’s  sponsor,  (4)  presence  of  al 1  of  the  data 
required  by  the  MPL  in  each  entry,  and  (5)  consistent 
recording  of  medications  in  that  section  of  the  MPL 
labeled  for  that  purpose.  In  addition,  it  was  determined 
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that  it  was  necessary  to  record  whether  or  not  the 
patient  had  been  seen  at  DACH ,  in  a  cl inic  wherein  it 
could  be  expected  that  the  MPL  could  be  completed  within 
the  last  fiscal  year.  This  data  was  determined  to  be 
necessary  a.s  a  gauge  to  the  number  of  these  patients 
which  might  be  anticipated  to  be  seen  in  the  fn 1  lowing 
year  and,  thus,  the  number  of  opportunities  to  improve 
comp  1  iance  with  the  JCAHO  standard  that  may  occur. 

Upon  selecting  the  characteristics  of  interest,  the 
next  tasks  were  to  determine  the  number  of  outpatient 
medical  records  held  by  DACH  and  the  quantity  of  these 
that  would  iiave  to  be  audited  to  achieve  a  95  percent 
level  of  significance.  Discussion  with  the 
Non-Commissioned  Officer  in  Charge  (NCOIC)  of  the 
Outpatient  Records  Branch  revealed  that  a  count  of  the 
actual  number  of  records  held  was  completed  on  October 
31 ,  1988.  This  revealed  that  a  total  of  47,843  records 

were  on  file.  In  further  discussion,  however ,  he  also 
indicated  that  several  additional  records  had  been 
received  and  a  number  of  others  permanently  removed  from 
the  files  in  the  two  weeks  since  this  inventory  was 
completed.  On  the  whole,  it  was  his  impression  that  the 
actual  stock  of  records  held  had  increased  moderately. 
Given  this  appraisal,  the  investigator  determined  to 
round  the  number  of  records  held  by  DACH  up  to  48,000. 
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Based  on  this  number,  the  required  sample  size  was 
determined  to  be  666  records.  Also  based  on  this 
number,  it  was  determined  that  the  90  percent  level  of 
comp  I  i  atice  was  equal  to  43,200  records.  Sample  records 
were  selected  at  random  by  the  investigator  and  reviewed 
in  the  records  room.  In  order  to  ensure  that  all  of  the 
records  held  were  equal  ly  represented,  an  approximately 
equal  number  of  records  was  selected  from  each  of  the  10 
color  coded  groups  of  records  held. 

Aud i t  Resu I ts 

Of  the  666  records  audited,  the  MPL  was  noted  to  be 
present  in  303,  or  57.51  percent.  In  another  119 
records,  it  was  observed  that  only  one  side  of  the  MPL,  a 
two  sided  form,  was  present.  However,  since  the  form  was 
not  complete,  these  were  not  counted  as  contributing 
toward  the  goal  of  compi i ance .  Of  the  383  records 
wherein  the  MPL  was  found  to  be  present,  347,  or  52.1 
percent  of  the  records  samp  led,  were  filed  in  the  correct 
location  in  the  records  jacket  in  accordance  with  AR 
40  66.  In  316,  or  approximately  44.45  percent,  of  the 
records  sampled  the  MPL  was  either  blank  or  improperly 
completed  and  only  116  records,  representing  17.42 
percent  of  the  sample,  evidenced  the  necessary  patient 
identification  data.  Medications  were  recorded  in  only 
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68  of  the  records  reviewed.  Of  these,  medications  were 
recorded  in  the  correct  location  in  60,  or  nine  percent 
of  the  sample.  Mo  medications  were  recorded  in  the 
remaining  315  records  wherein  the  MPL  was  present.  Only 
Olio,  or  .15  percent  of  the  666  records  audited,  was 
indisputably  in  full  comp  I  iance  with  the  JCAHO  standard. 

'n  another  25  records,  there  were  no  apparent  deficiencies 
except  that  no  medications  were  recorded  on  the  MPL. 
Together,  these  25  records  and  the  one  record  that 
clearly  met  the  standard,  represent  3.9  percent  of  the 
records  sampled  which  appeared  to  be  in  substantial 
compliance  with  the  JCAHO  standard.  It  was  also  noted 
that  395  of  the  records  reviewed,  or  59.31  percent  of  the 
sample,  indicated  that  the  patient  concerned  had  been 
seen  in  a  DACH  cl inic  during  FY  1988,  wherein  the  MPL 
could  have  been  updated  and  deficiencies  concerning  the 
location  in  which  the  form  was  filed  could  have  been 
cor  ec  ted  . 

Several  other  observations  were  also  made  during  the 
conduct  of  the  audit.  For  example,  the  most  common 
errors  made  included:  entering  a  major  problem  on  the 

Mf L ,  but  excluding  either  or  both  the  date  of  the  entry 
or  onset  of  the  probi em ;  filing  other  forms  on  top  of  the 
MPL,  over  time,  thereby  excluding  it  from  its  correct 


placement  in  the  record  and  easy  access  by  other 
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providers;  arid  the  lack  of  any  patient  identification 
data.  It  was  also  noted  that  several  different  types  of 
MPLs ,  other  than  the  HSC  Form  79-R  or  the  DA  Form  5571 , 
were  filed  in  the  records.  Of  these,  there  were  12  Navy 
MPLs ,  six  Air  Force  MPLs ,  and  61  Army  MPLs .  There  were 
at  least  two  versions  of  these  Army  MPLs,  an  IlGC  Form  79, 
to  which  no  reference  could  be  found  in  the  I  iter'ature, 
and  a  DeWitt  Arm.y  Hospital  (DAH)  Form  3,  dated  3 
September  1973.  The  latter  form  appeared  to  have  been  an 
ear  '  y  version  of  the  MF’L  generated  by  the  Department  of 
Fam  ily  Practice.  Finally,  it  was  also  noted  that  the^'e 
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Analysis  of  the  Audit  Data 

In  order  to  realize  the  first  of  this  study’s  three 
p r  p  o  B  e  s  ,  the  a  lj  d  ;  f  results  we  re  analyzed  to  establish  99 
percent  confidence  intervals  around  the  true  proportions 
of  the  characteristics  of  interest  within  the  finite 
population  of  outpatient  medical  records  held  by  DACH . 
These  calculations  are  presented  at  Appendix  D.  "’'he 
results  of  this  analysis  reveal-s  that; 

1  .  The  DCA  can  be  99  percent  conf  ident  that  a  MPL 
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is  pr'esent  in  between  53  and  62  percent:  of  the  outpatient 
■ecorda  he'd  by  DACH .  This  suggests  that  in  the  worst 
ta-jO  only  25,440  of  the  43,200  records  required  to  meet 
the  goa '  o—  90  percent  comp! i ance  with  the  JCAHO  standard 
C':)ntaiii  a  MPL.  In  the  best,  case  this  figure  improves  to 
a  to? a'  of  approximately  29,760  records  which  can  be 
anticipated  to  contain  a  MPL. 

2.  The  DCA  can  be  99  percent  confidcjnt  that  the  MPL 
is  consistently  filed  in  the  correct  location  within  the 
record  :n  between  47  and  57  percent  of  the  outpatient 
records  held  by  DACH.  This  suggests  that  in  the  worst 
case  only  22,560  records,  of  the  goal  of  43,2.00,  contain 
a  correctly  filed  MPL.  In  the  best  case  this  number-  of 
records  'ncr eases  to  27,360. 

3.  The  DCA  can  be  99  percent  confident  that,  of  the 
48,000  outpatient  records  held  by  DACH,  between  42  and  52 
percent  contain  a  MPL  which  is  either  blank  or  improperly 
completed.  Given  the  wo''St  case,  this  indicates  that  in 
24,960  of  the  records  held  by  DACH  wherein  a  MPL  is 
present,  it  is  either  blank  or  improperly  completed.  'n 
the  best  case,  this  number  declines  to  20,160. 

4.  The  OCA  can  be  99  percent  confident  that  between 
13  and  21  percent  of  the  48,000  outpatient  records  held 
by  DACH  contain  a  MPL  wherein  patient  identification  data 
has  been  recorded.  In  the  worst,  case  this  suggests  that 
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oniy  6,240  such  records  are  held.  In  the  best  case  this 
nuH'bcr  increases  to  (0,080  records. 

5.  The  DC A  can  be  99  percent  confident  that 

:T  I  e  <-?  .  1 '  a  t  i  o  r' s  are  recorded  in  the  correct  location  on  the 
MPL  in  between  six  and  12  percent  of  the  outpatient 
records)  held  !;>y  DACfl  .  This  indicates  that  in  the  worst 
case  medications  are  recorded  in  the  correct  scat  ion  on 
the  MP!...  in  approximately  2 , 8B0  records.  In  the  best  case, 
this  figure  improves  to  5,760  records. 

6.  The  DCA  can  be  99  percent  confident  that,  of  the 
48,000  outpatient  records  held  by  DACH ,  between  54  and  61 
percent  were  those  of  patients  seen  in  a  clinic,  dur  ing 
FY  1988,  wherein  the  MPL  could  have  been  properly 
completed  and  f : ' ed . 

The  results  of  this  analysis  demonstrate  that  the 
stock:  of  outpatient  med  '  ca  I  records  held  by  DACH  are  not 
in  substantia!  comp  I  i  ance .  Based  on  the  one  record  out 
of  the  samp  I e  taken,  whe  r  ein  ail  of  the  characteristics 
indicating  comp  I  i  ance  with  the  -JCAHO  standard  was  met,  we 
can  be  99  percent  confident  that  no  more  than  480  of  the 
rec  ore's  he'd  are  satisfactory  i  r)  all  respects.  The,? 
extant  degree  of  the  calculated  deviation  from  DACH ’ s  own 
goa  '  O'''  9  0  perr.ent  comp  I  iance  with  the  JCAHO  standard  is 

illustrated  in  Figure  1. 

Havng  determined  DACH’s  current  position  relative 
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to  th0  goal  of  90  percent  comp  1  i  ance  ,  the  question  whii:h 
frames  the  second  purpose  of  the  study,  is  how  much 
progress  toward  achieving  the  goal  can  be  made  if  every 
opportunity,  i.e.,  patient  visit,  to  correct  a  deficiency 
is  sciced  during  the  next  12  months?  Given  the 


CURRENT  STATUS  OF  THE  MPL  AT  DACH 
RELATIVE  TO  THE  GOAL  OF  90%  COMPLIANCE 


I  Best  Case 


KMiiJ  Worst  Case 


DACH  Goal 


Figure  1. 

assumption,  made  earl ier,  that  the  pattern  of  patient 
visits  experienced  during  FY  1988  will  r  ema in  constant  in 
the  ensuing  year,  and  based  on  the  information  derived 
from  analysis  of  the  audit  data,  it  may  be  anticipated 
that  between  54  and  61  percent  of  the  patient’s  whose 
records  are  he’d  by  DACH  will  be  seen  during  the  next 
year  in  a  cl  inic  wherein  the  WIPL  can  be  updated  and/or 
properly  filed.  If  each  of  these  opportunities  is 
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seized,  then  DACH  could  improve  its  position  relative  to 
the  goal  from  the  400,  or-  fewer  records  presently  in 
compl i ance .  The  relative  improvement  over  the  course  of 
the  one  year  would  I'e  between  5,400  and  6,100  percent. 
This  '-.i  inference  is  ill  u  strata  d  in  Figure  2.  These 


POTENTIAL  IMPROVEMENT  IN  COMPLIANCE 
ONE  YEAR  AFTER  INTERVENTION 
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Figure  2. 

figures  do  not,  of  course,  take  into  consideration  the 
dynamics  of  the  receipt  of  new  records  by  DACH  for  newly 
arrived  patients,  the  transfer  of  records  as  some 
patients  depart  the  area  permanently,  and  the  removal  of 
some  number  of  outpatient  medical  records  from  tfie  files 
every  year  as  records  are  retired.  If  managed 
appr opr i a te I y ,  the  cumulative  effect  of  these  factors 


could  serve  to  enhance  the  overal I  compl i ance  with  the 
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the  JCAHO’s  standard.  The  actual  level  of  improvement 
Within  each  of  the  characteristics  studied,  as  we  II  as 
the  rema ining  deficit,  in  terms  o  f  mee  ting  the  goal, 
following  this  intervention,  are  summar ized  in  Table  1. 
The  data  presented,  however,  does  not  take  the  positive 
effects  of  the  aforementioned  dynamics  into  consideration 
and,  thus,  should  be  v i awed  as  the  minimum  achievable 
result  or  as  somewhat  understated. 


Improvement  One  Year  After  Intervention 


Character ist ic 

1  o  f  Concer  n 

f 

i 

1 
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Best 

Case 

Worst 

Case 

Best 

Case 

Worst 

Case 

1 

j  MPL  Present 

480 

480 

1  3 , 920 

1 7 , 280 

j  MPL  Proper  1 y 

1  Filed 

1  ,920 

3 , 360 

13,920 

1 7 , 280 

1 

j  Pat i ent  1 0  Data 
Pr  esen  t 

24,480 

23 , 520 

1 3 , 920 

1 7 , 280 

Entries  Properly 
Comp  1 e  ted 

1 9 , 200 

1 9 , 680 

1 3 , 920 

1 7 , 280 

Med i cat i ons 

Cor  r  ec  t I y 
Recorded 

23 , 250 

23 , 040 

1 3 , 920 

1 7 , 280 

»  Indicates  the  number  of  outpatient  medical  records 

that  could  be  improved,  in  regard  to  each 
characteristic  of  interest,  one  year  after 
implementation  of  the  intervention. 

»>«  -  Represents  the  deficit  between  the  improvement 

achieved  one  year  following  implementation  of  the 
intervention  and  the  goal  of  90  percent  comp  I  i ance . 

Table  1 . 
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Summary 

!t  is  evident  from  the  information  derived  in  this 
study  that  the  outpatient  medical  records  held  by  DACH 
genera! ly  f a i I ,  at  present,  to  meet  the  JCAHO  standard 
and  the  hospital  ’s  own  goal  of  90  percent  comp  I  i ance . 

This  information  also  suggests  that  it  is  uni i ke I y  that 
the  hospital’s  goal  of  90  percent  comp  I  i ance  can  be 
achieved  in  one  year  if  the  only  action  taken  to  address 
the  problem  is  to  begin  correctly  completing  the  MPLs  and 
ensuring  that  they  are  enclosed  in  the  patient's  records 
as  they  present  for  care  in  appropriate  clinics.  \Wh  i  I  e 
it  seems  clear  that  substantial  progress  toward 
comp  1  i ance  can  be  achieved  by  pursuing  this  tact,  a 
definitive  completion  date,  or  time  required  to  achieve 
90  percent  comp  I  i ance ,  cannot  be  accurately  projected. 
Certainly,  if  DACH ’ s  goal  is  to  be  in  90  percent 
compi i ance  with  the  JCAHO  standard  prior  to  the  next 
full  survey  in  April  1989,  a  more  resource  intensive 
approach  must  be  considered.  Even  at  this,  however,  the 
intervention  addressed  throughout  this  paper  wi  I  I  need  to 
be  an  integral  part  of  any  remedial  program.  If  not, 
then  only  an  interim  resolution  to  the  prob! em  will  have 
been  achieved  and  the  level  of  compi  iance  wi  I  I  begin  to 


decrease  shortly  thereafter. 
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Ml.  CONCLUSIONS  AND  RECOMMENDATIONS 

Cone  I  us i ons 

Many  conclusions  might  be  drawn  from  the  information 
derived  in  the  course  of  this  study.  In  the  view  of  this 
investigator,  however,  there  three  of  import  to  this 
study  itself.  The  first  two  have  to  do  with  the 
implementation  and  use  of  the  MPL  within  the  Army  Medical 
Department  (AMEDD) ,  and  the  third  addresses  the  issue  of 
DACH ’ s  comp  I  i ance  with  the  JCAHO’s  standard  regarding  the 
MPL  . 

The  review  of  the  I iterature  clearly  indicated  that 
Weed  intended  the  POMR  to  be  a  framework  to  ensure  order 
and  consistency  in  the  medical  record.  The  MPL,  in  his 
concept,  was  the  key  document  in  the  record,  to  which  all 
others  were  indexed.  Thus,  the  MPL  was  at  once  the 
instrument  which  was  the  vehicle  to  f ac i I i tate  that  order 
and  consistency,  and  also  a  valuable  tool  for  consultants 
and  secondary  providers,  researchers  and  epidemiologists, 
and  qual i ty  assurance  monitors.  Within  the  AMEDD, 
however,  it  would  appear  that  implementation  of  the  use 
of  the  MPL  was  only  a  response  to  the  creation  of  a  new 
accreditation  standard.  More  specifically,  a  response 
that  appears  to  have  occurred  without  an  appreciation  of 
the  central  role  of  the  MPL  in  the  medical  record. 
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Witness  to  this  conclusion  is  borne  by  the  office  of 
HGC  ’  s  Inspector  Genera!  which  freely  admits  that 
contingencies  regarding  comp! i ance  with  the  MPL  standard 
are  a  common  occurrence  among  Army  hospitals  that  undergo 
a  JCAHO  survey.  It  would  seem  that  what  HSC  has  done  is 
tr  create  a  form  and  mandattj  its  use  without  an 
appreciation  for  its  broader  purpose,  i.e.,  beyond  simply 
satisfying  the  JCAMO.  And,  since  the  AMCOD  ’  s  IV^L  is  not 
an  index  to  the  rest  of  the  record,  it  evidences  no 
thread  of  continuity  with  the  plans  and  progress  notes 
recorded  elsewhere  in  the  record.  Consequently,  it  is 
not  surprising  that  AMEDD  provider’s  are  neither 
consistent  or  concientious  about  recording  the  data 
required  by  the  MPL,  and  subsequently,  that  the  JCAHO 
routinely  levies  contingencies  against  Army  hospitals 
that  it  surveys.  The  conclusion  that  this  investigator 
has  drawn  is  that  the  MPL  currently  employed  by  the  AMEDD 
is  poorly  conceived  and  implemented. 

The  second  conclusion  drawn  from  the  study  addresses 
the  AMEDD ’ s  implementation  of  the  MPL  throughout  the  Army 
health  care  delivery  system ,  and  also  the  ability  of  DACH 
and  other  Army  MTFs  to  execute  that  effectively 
implementation.  First,  cursory  discussion  with  providers 
at  DACH  indicates  that  few  if  any  of  them  have  been  given 
any  formal  training  in  the  use  of  the  MPL.  Second,  there 
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is  no  existing  guidance  within  the  AMEDO  which  defines 
exactly  what  constitutes  a  problem  of  such  significance 
that  if  merits  being  documented  as  either  a  major  or 
minor  problem.  This  dil emma  is  further  exacerbated  by 
the  lack  of  any  guidance  as  to  how  to  record  a  contact 
with  a  patient  whose  visit  has  been  for  the  purpose  of 
health  maintenance,  e.g.,  i  mrnu  n  i  za  t  i  o  ns  ,  or  something 
less  than  a  minor  problem  in  an  otherwise  health  patient. 
The  difficulty  this  ci r cums tance  poses  is  that  not  all 
providers  have  a  uniform  concept  of  what  constitutes  a 
problem,  much  less  a  minor  versus  a  major  problem.  And, 
as  in  the  latter  instance  posed  above,  how  does  a 
provider  convey  to  a  third  party,  i.e.,  a  JCAHO  surveyor, 
that  wh i le  a  patient  has  indeed  been  seen,  the  nature  of 
the  problem  or  complaint  did  not  warrant  an  entry  on  the 
MPIP  It  seems  rather  clear  that  the  lack  of  guidance  in 
this  area  only  serves  to  exacerbate  the  problem. 

The  third  conclusion  drawn  from  this  study  is  that 
DACH  is  not  substantially  in  comp liance  with  the  JCAHO 
standard  or  its  own  goal,  concerning  the  use  of  the 
med  i  ca I  summary  list,  at  this  t ime .  Wh i  I e  it  seems 
evident  that  significant  progress  toward  both  can  be 
achieved  over  the  course  of  the  next  year  by  pursuing  a 
tact  whereby  extant  deficiencies  are  corrected  and 
records  are  updated  as  patient’s  present,  there  is  I ittle 
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that  can  be  done  to  achieve  a  significant  improvement 
prior  to  April  1989,  the  scheduled  start  of  the  next  full 
survey.  This  is  not  to  convey  that  a  significant 
improvement  cannot  be  achieved  if  some  more  aggressive 
a.cd  '■esource  intensive  approach  is  taken  to  the  problem.. 
Fai I i ng  this,  it  is  anticipated  that  90  to  100  percent 
com.pliance  can  be  achieved  within  three  years,  if  the 
program  is  pursued  consistently  throughout  the  period. 

Recommendat i ons 

It  is  the  recommendation  of  this  investigator  that 
the  approach  explored  in  this  study,  i .e,  the  proper 
comp letion  and  filing  of  MPLs  as  patients  present  over 
time,  should  be  pursued.  While  the  immediacy  with  which 
a  significant  impr  oveme  nt  in  overall  comp  Nance  can  be 
achieved  by  a  more  resource  intensive  approach  to  the 
problem  is  not  discounted,  it  is  felt  that  this  would 
certainly  lead  to  some  decreased  availability  of  care  in 
the  short  term  and  might  we  I  I  be  perceived  by  the  JCAHO 
as  a  shot  in  the  arm  rather  than  a  remedy.  It  is  felt 
that  the  more  conservative  approach,  although  slower,  is 
more  I i ke I y  to  yield  the  desired  results.  In  order  to 
effect  this  recommendation,  the  implementation  of  a 
program  embodying  the  f o I  lowing  points  is  recommended; 

1.  Provider  education  and  command  emphasis.  This 
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should  include  a  structured  command  effort  to  bring  the 
MPL  to  the  attention  of  providers  in  tne  hospital ,  as  the 
current  data  suggest  many  are  unaware  of  it.  Further, 
this  effort  should  c ommu nicate  the  hospital's  goal  of  90 
percent  comp  I  ' ance ,  as  we  I  1  -s ,  the  need  for  complete  and 
accurate  entries.  In  addition,  the  chief  of  '^nnh 
cl  inical  department  must  develop  a  concurrent  review  such 
that  no  medical  record  of  a  patient  seen  within  a 
Subordinate  service  or  clinic  is  returned  to  the  records 
room  unless  the  MPL  has  been  updated,  the  patient’s 
identification  data  affixed,  and  the  form  properly  filed. 

2 .  Deve ! opment  of  a  local  policy,  i.e.,  one 
specific  to  DACH  as  opposed  to  the  entire  AMEDD, 
specifying  the  entry  to  be  made  on  the  WIPL  to  document 
the  visit  of  a  patient  with  no  remarkable  medical 
history,  no  significant  complaint,  or  simply  requiring 
care  in  the  way  of  health  maintenance.  Such  an  entry 
would  convey  to  secondary  providers,  consultants,  and 
third  parties,  e.g.,  a  JCAHO  surveyor,  that  cognizance 
of  the  past  medical  history  as  we  I  I  as  current 
circumstances  of  the  patient,  whose  record  is  being 
reviewed,  has  indeed  been  taken  and  noted  by  appropriate 
entires.  Further,  a  taxonomy  should  be  developed,  and 
conveyed  to  staff  providers,  enabl i ng  them  to  identify 
and  distinguish  among  major  problems.  It  is 
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recommended  that  the  development  of  this  language  and 
f .  aiT.ev-o 1<  is  th  '  proper  province  of  the  chiefs  of  the 
various  clinical  depar  tme  nts  v/working  together. 

3.  Development  of  a  procedure  to  ensure  that  the 
records  of  al I  patients  which  are  newly  received  by  DACH , 
to  become  a  part  of  its  files,  are  revi ewed .  The  purpose 
of  this  re\/iew  would  be  to  ensure  that  a  MPL  is  completed 
un  each  such  patient,  that  it  is  made  current,  and  that 
it  is  properly  filed  in  the  med ical  record.  Further, 

"bis  procedure  should  include  that  records  being  charged 
out  of  the  records  room  wi  I  I  not  be  released,  except  in 
emergent  c i r  cums  tances ,  until  the  WPL  is  filed,  or 
refiled  if  necessary,  in  the  correct  location  end  the 
patient's  identification  data  is  affixed.  Also,  no 
record  is  to  be  returned  to  the  f i I es  unti I  these  actions 
have  been  completed. 

4.  An  ongoing  monitor  be  estabi ished  in  order  to 
stay  abreast  of  the  changing  level  of  comp  I  i ance .  To 
that  end,  it  suggested  that  this  study  be  ropl i cated 
quarterly  unti I  such  time  as  this  program  is  supplanted 
by  a  new  one  or  the  hospital’s  Executive  Committee 
determines  that  such  an  ongoing  monitor  is  not  needed. 

As  the  study  is  repi icated  each  quarter,  it  is  also 
recommended  that  a  provider  with  appropriate 

qual if ications,  in  addition  to  the  required 
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adm i n i 3 t r a t i ve  personnel,  be  assigned  to  the  monitoring 
ata'l' .  '  i.  -  bo  the  responsibility  of  this  person  to 

determine  whether  or  not  both  major  and  minor  problems, 
past  procedures,  and  current  medications,  that  might  not 
be  recognized  by  administrative  personnel ,  ar^  indeed 
i  d  trn  t  i  f  i  e  d  and  r  e  c  o  r  d  cj  d  , 

In  addition  to  the  tnrogoing,  it  is  recommended 
that  the  progran.  addressed  above,  having  been 
satisfactorily  impi emen ted  and  refined,  be  presented  to 
use  as  a  mode  1.  Finally,  it  isr  ecommend  ed  that  the 
suggestion  be  put  to  HSC  that  a  system  wide  study  to 
determine  just  how  successful  the  implementation  of  the 
MPL  has  been  should  be  pursued.  It  is  felt  that  the 
result  will  identify  a  sys  tem-w i de  pr  ob I em . 
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APPENDIX  A; 


HSC  Form  79-R,  Master  Problem  List 
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APPENDIX  B: 


DA  Form  5571.  Master  Problem  List 
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APPENDIX  C; 


Sample  Size  Calculations 
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Sample  Size  Calculations 

The  objective  of  these  calculations  was  to  determine 
the  necessary  sample  size,  of  outpatient  medical  records 
to  be  examined,  to  achieve  a  99  percent  level  of 
significance.  The  population  of  outpatient  records  from 
which  the  sample  was  drawn  numbered  48,000.  In  order  to 
enhance  the  reliability  of  the  samp le,  an  interval 
estimate  of  five  percent  (d  =  .05)  was  selected.  Since 
no  information  existed  through  which  estimates  of  the 
proportions  of  the  characteristics  of  interest  could  be 
determined,  the  probabi I i ty  of  their  occurrence  (p)  was 
set  to  .5,  as  it  was  known  that  this  would  yield  the 
maximum  sample  size. 

The  required  sample  size  was  determined  by  use  of 
the  f ormu I  a ; 

n  =  z’^pq  .where 
d* 

n  =  the  sample  size,  or  the  number  of  records  to 
be  exam i ned , 

z  =  the  confidence  coefficient  for  the  standard 
norma  I  curve , 

p  --  that  proportion  of  the  population  of  interest 
possessing  the  characteristics  of  interest, 

q  “  1  -  p ,  and 

d  =  the  distance  of  the  sample  proportion  from  the 
standard  normal  curve. 

Using  this  formula,  we  derive: 
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n  =  (2.58)^  ( ■ 5) ( . 5) 

( .05) “ 

=  (6,6564)  (.25) 

.  0025 

=  1 ■ 664 
.  0025 

=  665.64  or  666  records 

G  i  nee  five  percent  of  the  population  of  concern  was 
calculated  to  Le  2,400  recoras,  it  was  determined  that 
the  finite  population  correction  factor  did  not  have  to 
be  considered.  Thus,  it  was  determined  that,  in  order  to 
achieve  a  sample  at  the  99  percent  level  of  significance, 
666  outpatient  medical  records  would  have  to  be  examined. 
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APPENDIX  D: 


Confidence  Interval  Calculations  and  Transformations 
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Confidence  Interval  Calculations  and  Transformations 

In  order  to  accompi i sh  the  objectives  of  this  study 
it  was  necessary  to  construct  99  percent  confidence 
intervals  around  the  true  proportions  of  the 
characteristics  of  interest  in  the  population  of  concern, 
■^he  upper  and  lower  range,  for  each  characteristic,  was 
then  transformed  into  the  actual  number  of  records  that 
equated  to  that  percentage.  To  perform  the  calculation 
of  confidence  intervals,  the  foil ow i ng  f  o  r mu  I  a  was 
ernp  I  oyed  ; 


where , 

X  =  the  number  of  records  in  the  sample  taken 

wherein  the  characteristic  of  interest  occurs, 

p  =  the  proportion  of  records  in  the  sample  taken 
wherein  the  characteristic  of  interest  occurs, 

Z  <  I  — i;  j  =  the  confidence  coefficient  for  the 
standard  normal  curve,  and 

n  -  the  total  number  of  records  sampled. 

This  procedure  simply  requires  the  drawing  of  a 
sample  from  the  population  of  interest.  Then,  the  sample 
proportion,  of  the  characteristic  of  concern,  is  computed 
by  dividing  the  number  of  cases  wherein  this 
characteristic  occurs  by  the  total  number  of  cases  in  the 
sample.  This  sample  proportion  is  then  used  as  a  point 
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estimator  of  the  population.  According  to  Daniel  (1983) , 
the  confidence  interval  is  then  obtained  by  the  formula; 
estimator  (reliability  coefficient)  x  (standard  error). 
These  calculations  fol low; 

I.  Calculation  of  the  true  proportion  of  the 
population  of  outpatient  medical  records  held  by  DACH  in 
which  a  MPL  is  present; 


383 

n  =  666  X  =  383  'p  =  -  =  0.5750751 

666 


.575  (1-.575)  -1  .575  (1-.575) 

P(  .  575  -  2  58  \| - <  P  <  -575  +  2.58^ - )  = 


1 


666 


666 


P( . 575  -  2 


(  .  575)  (  .  425)  (  .  575)  (  .  425) 

<  P  <  .575  +  2.58  \ - ) 


666 


666 


P  (.575  -  2 


.  58~^ 


.2443637  .2443637 

-  <  P  <  .575  +  2.58  ^ - )  =  .99 


666 


666 


P  (.575  -  2.58  "N.  0003669  1  P  1  .575  +  2.58  "N.  0003669)  =  .  99 

P  (.575  -  2.58  (.0191546)  £  P  <  .575  +  2.58  (.0191546))  =  .99 

P  (.575  -  .0494189  £  P  <  .575  +  .0494189)  =  .99 

P  (.5256562  £  P  £  .624494)  =  .99 
P  ( . 53  <  P  <  . 62)  =  .  99 


Thus,  we  can  be  99  percent  confident  that  the  true 
proportion  of  these  records  which  contain  a  MPL  is 
between  53  and  62  percent.  These  percentages  are 


.  99 


99 


transformed  by; 
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X 

48 , 000 
1  OOX 
X 


53 

X  - 

1  00 


=  2.544,000 


25 , 440  records 


X 

48,000 
1  OOX 
X 


62 

X  - 

1  00 

=  2,976,000 

=  29,760  records. 


2.  Calculation  of  the  true  proportion  of  the 


population  of  outpatient  medical  records  held  by  DACH  in 
which  the  MPL  is  properly  filed: 


347 

n  =  666  X  =  347  p  =  -  =  .521 

666 


P(  . 521  -  2 


P(  .  52'  -  2.58 


1 


521  ( 1  -  .  521  ) 


666 


(.521) .. 479) 


<  P  <  .521  +  2 


.  50"^ 


.521  ( 1  - . 521  ) 


-)  = 


666 


(.521) ( .479) 


<  P  <  .521  +  2.58 


-)  = 


666 


666 


2495581  ->  .2495581 

P  (.521  -  2.58  \| -  <  P  <  .521  +  2.58  \ - )  =  -99 


1- 


666 


666 


^  (.521  -  2.58  ll.  0003747  1  P  1  .521  +  2.58  ij.  0003747)  =  .99 

P  (.521  -  2.58  (.0193572)  <  P  <  .52  1  +  2.58  (.0193572))  ==  .99 
P  (.521  -  .0499416  £  P  <  .521  .0499416)  =  .99 

P  (.4710794  <  P  <  .5709626)  =  .99 

P  (  .  47  <  P  <  .57)  ==  .99 


Thus,  we  can  be  99  percent  that  the  true  proportion 
of  the  population  of  outpatient  medical  records  held  by 
DACH  in  which  the  MPL  is  properly  filed  is  between  47  and 


.  99 


.  99 
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40 , 000 


1  oox 


2 . 256 . 000 
22,560  records 


48,000  100 

100X  =  2,736,000 

X  =  27,360  records 


3.  Calcuiatio 


n  of  the  true  proportion  of  the 


nopulation  of  outpatient  medical  records  held  by  DACH  in 
which  the  MPL  is  either  blank  or  improperly  completed; 


=  666  X  =  316  p  = 


=  .474 


P ( . 4  7  4  2.5 


_f  .  474  (1  -  .  474^  ~\\  •  -5  74  (1-.474) 

o  \ - - 1  5  ^  2.58  M - )  =  -99 

1  ecc  ’  666 


p  (  , 474  -  2,58 


(.474)(.526)  _  ( . 474) ( . 526) 

_  i.  P  £  -^74  +  2.58  \ - — — )  =  .99 

666 


-I  .  2493484  -1  .2493484 

P  (.474  2.58^ —  1  P  £  .474  +  2.58  \  )  =  -99 

\  666  1 

P  (.4  74  -  2.58  ■^.  0003744  £  P  <  .474  +  2.58  Pj.  0003744)  -  .99 

P  (.474  -  2.58  (.0193494)  £  P  £  .474  +  2.58  (>0193494))  .99 

p  (.474  -  .0499215  £  P  £  .474  +  .0499215)  =  .99 

P  (.424553  £  P  £  .524396)  -  .99 
P  ( . 42  <  P  <  .52)  =  .99 


Thus,  we  can  be  99  percent  confident  that  between  4; 
and  52  percent  of  all  of  the  outpatient  medical  records 
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held  by  DACH  contain  a  MPL  vA/hich  is  either  blank  or 
improperly  completed.  These  percentages  are  transformed 
by  ; 


X 

48 , 000 
1  OOX 
X 


42 
1  00 

2,016 ,000 
20,160  r ecor ds 


X 

48 , 000 
1  OOX 
X 


52 

X  - 

1  00 

=  2,496,000 

r-  24,960  records. 


4.  Calculation  of  the  true  proportion  of  the 
population  of  outpatient  medical  records  held  by  DACH  in 
.vhcl.  pat‘''’'t  ■  den  t  i  f  i  cat  i  on  data  is  not  recorded  on  the 

MPL; 


1  1  3 

n  =  666  X  =  113  p  =  -  =  .170 

666 


P ( . 1 70  -  2.58 


.170  ( 1  - .  1 70) 


<  P  <  .170+2 


666 


.58"^ 


.170  ( 1  - .  1 70) 


-)  = 


666 


(  .  1 70)  { . 830)  ^  ( .  1 70)  ( . 830) 

P(.170  -  2.58  \| -  <  P  <  .170  +  2.58  \  - )  = 


‘V 


666 


666 


P  (.170  -  2.58 


n  .  1408819  nl  . 1408819 

\ -  <P<  .170  +  2.58 


666 


1- 


)  ^  .  99 


666 


P  (.170 

-  2.58 

■^.0002  1  1  5 

< 

P 

< 

.  1  70 

+ 

2 . 58  ■^.0002  115)  = 

.  99 

P  (.170 

-  2.58 

(  .014543) 

< 

P 

< 

.  1  70 

+- 

2.58  (.014543))  = 

.  99 

P 

(.170 

.0375209 

< 

P 

< 

.  1  70 

+ 

.0375209)  .99 

P 

(.1321 488 

< 

P 

< 

.2071906)  =  .99 

.  99 


.  99 
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P  (.13<P<  .21)  ^  .99 


Thus,  we  can  be  99  percent  confident  that  between  13 
and  21  percent  of  the  outpatient  medical  records  held  by 
DACH  contain  a  MPL  on  which  the  patient  identification 
has  not  been  recorded.  These  percentages  are  transformed 
by  ; 


X  1  3 


X  2 1 


X 


X 


48,000  100  48,000  100 

100X  =  624,000  lOOX  =  1,008,000 

X  =  6,240  records  X  -  10,080  records. 

5.  Calculation  of  the  true  proportion  of  the 
population  of  outpatient  medical  records  held  by  DACH  in 
which  medications  are  recorded  in  a  location  on  the  MPL 
that  is  I abe I ea  for  that  purpose: 


n  =  666  X  =  60 


60 


666 


090 


.090  (1-.090) 

P(.090  -  2.58  y -  <  P  <  .090  +  2.58 


666 


P(  . 090  -  2.58 


1 


( . 090) (.910) 


666 


£  P  £  .  090  +  2 . 58  "1 - 


090  (1-.090) 


-)  = 


666 


090) (.910) 


-)  = 


666 


P  (  . 090  -  2 


.50l 


.246023  .246023 

<  P  <  .090  +  2.58  \ - )  =  .99 


666 


666 


.99 


.  99 
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P  (.090  -  2.58  1.000  123  1  <  P  f  .090  +  2.58  ■VOOO'231)  - 

P  (.090  -  2.58  (.011095)  £  P  £  .090  +  2.58  (.0’1095))  = 

P  (.090  -  .0206251  £  P  £  -090  +  .0286251)  -  .99 

P  (.061465  £  P  £  .061465)  =  .99 

P  ( . 06  <  P  <  .12)  =  .99 


we  can  be  99  percent  confident  that 
red  icat  ions  are  recorded  in  the  correct  iocation  on  the 


WPL  i n  be  tween 


and  12  percent  of  the  outpatient 


Tied  i  cal  -ecords  held  by  DACH .  These  percentages  are 
tr ans  formed  by : 


48 . 000 


288 , 000 


, 880  records 


48 , 000 


1  OOX 


576 ,000 


5,760  records 


6.  Calculation  of  the  true  proportion  of  the 
population  of  outpatient  medical  records  held  by  DACH 
which  document  that  the  patient  concerned  was  seen  at 
DACH,  in  a  clinic  wherein  the  MPL  could  have  been 
proper  I y  comp leted  and  filed,  during  FY  1988; 


n  =  666  X  =  395  p  ~ 


.593  (1-.593)  n  .593  (1-  .593) 

P  (  .  593  -  2.58  )  -  £  P  £  •  593  ^  2.581 - ) 

1  666  1  666 


I 
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;93  2.50 


( . 593) { . 407) 


<  P  <  .  593  (-  2.58 


666 


1 


( . 593) ( . 407) 


-) 


666 


. 24 1 3337 

P  (.593  -  2.53  \1 - <  P  <  .593  +■  2.58 


1 


666 


1 


. 24  1  3337 


-)  .99 


666 


(  593  2.53  0003624  <  P  £  .593  -i  2.58  0003624)  =  .99 

(.593  2.58  (.0190368)  <  P  <  .593  +  2.58  (.0190368))  =  .99 

(.593  .0491149  £  P  £  .593  +  .0491149)  =  .99 

(  .5439782  £  P  £  .6122.8)  ^  .99 

P  ( . 54  <  P  <  .61)  =  .99 


Thus,  we  can  be  99  percent  confident  that  between  54 
and  61  pc'cent  of  the  patients  whose  outpatient  recorcir> 
are  held  by  OACH  were  seen  in  a  clinic  during  PY  1988 
wherein  the  MPL  could  have  been  properly  completed  and 
filed.  These  percentages  are  trans  formed  by : 


48 , 000 

1  oox 

X 


54 
1  00 

2 , 592 , 000 

25 , 920  records 


6  1 


48,000  100 

100X  =  2,928,000 

X  29,280  records. 


7.  Calculation  of  the  true  proportion  of  the 
popu'ation  of  outpatient  medical  records  held  by  DACH 
which  are  in  complete  comp! i ance  with  the  JCAHO  standard 
regarding  the  use  of  the  MPL: 
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n  -  666  X  =  1  P  ~  -  -  .002 

666 


(.002  2.50  (.0015166)  £  P  £  .002  t  2.58  (.0015166))  -  .99 


P  (.002  -  .0039128  <  P  <  .002  +  .0039128)  =  .99 

P  (-.0024113  £  P  £  .0054143)  =  .99 

P  (0£P£  .01)  =  .99 

■^bjs,  we  can  be  99  percent  confident  that  no  more 
than  one  percent  of  the  outpatient  medical  records  he ! d 
by  DACH  m.eet  the  JCAHO  standard  in  all  respects.  This 
percentage  is  transformed  by; 

X  1 

- - 

48,000  100 

100X  =  48,000 


X 


480  r  or  ds . 
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